IN THE CLAIMS: 



1. (Currently Amended) A method for determining and maintaining dialog focus in a 
conversational speech system comprising the steps of: 

maintaining a multi-modal history of events that result from user interaction with one or 
more user applications of a multi-modal computing system, wherein the event s are maintained 
in chronological order, and wherein the events are linked by event type, wherein an event type 
includes a change of dialog focus; 

receiving and processing a user speech command directed to one of a plural ity of the 
user applications of the multi-modal computing system; 

presenting a command associat e d with an application to a dialog manag e r, th e 
application associated w ith th e command b e ing one of a plurality of active applications that are 
unknown to th e dialog manag e r; 

the a dialog manager determining a target of the speech command by determining a 
current context of the speech command by reviewing the a multi-modal history of events; 

determining at least one method responsive to the command based on the determined 
current context; and 

executing the at least one method responsive to the command associated with the 
application; and 

changing dialog focus to on e of the activ e applications bas e d on us e r interaction with 

the conversational syst e m. 

2. (Currently Amended) The method as recited in claim 1, wherein the dialog manager 
determines a target application type from the current context which is responsive to the 
command, wherein the target application type is abstracted from the user appl ications supported 
by the multi-modal system step of presenting a command includes th e step of employing at 
least on e multi modal devic e for pres e nting th e command. 
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3. (Currently Amended) The method as recited in claim 1 2, comprising receiving input 
commands from a user interacting with the multi-modal system using a plurali ty of modalities 
including wherein the at loast one multi modal devic e for pr e s e nting the command includ e s 
on e of a telephone, a computer, and a personal digital assistant. 

4. (Currently Amended) The method as recited in claim 1 5 wherein the step of 
determining a current context of the command by reviewing a multi-modal history of events 
includes searching th e st o p of providing a link e d list of all events in the multi-modal history of 
events by traversing linked events. 

5. (Currently Amended) The method as recited in claim I 4, wherein the events in the 
multi-modal history of events are linked by time, transaction and class includ e s at least on e of 
events linked by tim e , by type, by transaction, by class and by dialog focus . 

6. (Currently Amended) The method as recited in claim 1 , wherein the step of 
determining at least one method includes the step of referencing all active the user applications 
of the multi-modal computing system using a component control to determine the at least one 
method of a user application which is appropriate based on the current context of the speech 
command. 

7. (Currently Amended) The method as recited in claim I, wherein the speech 
command is presented in a formal language such that a plurality of human utterances represent 
an action to be taken. 

8. (Currently Amended). The method as recited in claim I, wherein the step of 
determining a current context of the command by reviewing a multi-modal history of events 
includes the st e p of the dialog manager maintaining a current dialog focus and a list of expected 
responses , which is used by m the dialog manager to provide a reference for determining the 
current context. 
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9. (Original) The method as recited in claim 1, further comprising the step of querying 
a user for one of information needed to resolve the current context and information needed to 
take an appropriate action. 

10. (Currently Amended) A prografn storage device readable by machine, tangibly 
embodying a program of instructions executable by the machine to perform method steps for 
determining and maintaining dialog focus in a conversational speech system, the method steps 
comprising: 

maintaining a multi-modal history of events that result from user interaction with one or 
more user applications of a multi-modal computing system, wherein the event s are maintained 
in chronological order, and wherein the events are linked by event type, wherein an event type 
includes a change of dialog focus; 

receiving and processing a user speech command directed to one of a plurality of the 
user applications of the multi-modal computing system; 

pr e s e nting a command associat e d with an application to a dialog manager, th e 
application associat e d with th e command being one of a plurality of activ e applications that are 
unknown to th e dialog manag e r; 

the a dialog manager determining a target of the speech command by determining a 
current context of the speech command by reviewing the a multi-modal history of events; 

determining at least one method responsive to the command based on the determined 
current context; and 

executing the at least one method responsive to the command associat e d with the 
application; and 

changing dialog focus to one of the activ e applications bas e d on us e r interaction with 
th e conv e rsational system. 

1 1 . (Currently Amended) The program storage device as recited in claim 10, wherein 
the dialog manager determines a target application type from the current context which is 
responsive to the command, wherein the target application type is abstracted from the user 
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applications supported by the multi-modal system st e p of pr e senting a command includ e s th e 
st e p of employing at least on e multi modal device for pr e s e nting the command. 

12. (Currently Amended) The program storage device as recited in claim 10 ++, 
comprising instructions for receiving input commands from a user interacting with the multi- 
modal system using a plurality of modalities including wher e in the at l e ast on e multi modal 
devic e for pres e nting th e command includes on e of a telephone, a computer, and a personal 
digital assistant. 

13. (Currently Amended) The program storage device as recited in claim 10, wherein 
the instructions for step-ef determining a current context of the command by reviewing a multi- 
modal history of events includes instructions for searching the step of providing a link e d list of 
all e v e nts in the multi-modal history of events by traversing linked events. 

14. (Currently Amended) The program storage device as recited in claim 10+^, wherein 
the events in the multi-modal history of events are linked by time, transaction and class includes 
at l e ast one of events linked by time, by typ e , by transaction, by class and by dialog focus . 

15. (Currently Amended) The program storage device as recited in claim 10, wherein 
the instructions for step-ef determining at least one method includes the step of referencing aW 
active the user applications of the multi-modal computing system using a component control to 
determine the at least one method of a user application which is appropriate based on the 
current context of the speech command. 

16. (Currently Amended) The program storage device as recited in claim 10, wherein 
the speech command is presented in a formal language such that a plurality of human utterances 
represent an action to be taken. 
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17. (Currently Amended) The program storage device as recited in claim 10, wherein 
the instructions for step-ef determining a current context of the command by reviewing a multi- 
modal history of events include s the st e p of instructions for the dialog manager maintaining a 
current dialog focus and a list of expected responses , which is used by «% the dialog manager to 
provide a reference for determining the current context. 

18. (Currently Amended) The program storage device as recited in claim 10, further 
comprising the step of instructions for querying a user for one of information needed to resolve 
the current context and information needed to take an appropriate action. 

19. (Currently Amended) A multi-modal computing system for d e t e rmining and 
maintaining dialog focus in a conv e rsational spe e ch syst e m comprising: 

a multi-modal history of events to maintain meta information of events that result from 
user interaction with one or more user applications of the multi-modal computing system, 
wherein the events are maintained in chronological order, and wherein the events are linked by 
event type, wherein an event type includes a change of dialog focus; 

a dialog manager that maintains a current dialog focus for one of a plurality of user 
a pplications and a list of expected responses, wherein the dialog manager dete rmines a target of 
a speech input event by determining a current context of the speech input event using the multi- 
modal history of events or the list of expected responses; adapted to receiv e commands from a 
user, th e dialog manag e r maintaining a current dialog focus for on e of a plurality of active 
applications and a list of exp e ct e d respons e s for determining a curr e nt context of the commands 
rec e iv e d ; 

a multi modal history coupl e d to the dialog manager for maintaining an ev e nt list of all 
events which affected a state of th e syst e m, the multi modal history adapt e d to provid e input to 
the dialog manager for d e t e rmining th e current cont e xt of the commands received, wherein the 
e vents in the multi modal history includ e change of dialog focus e v e nts; and 

a control component adapted to select at least one method responsive to the speech input 
event based on the target of the speech input event as determined by the dialog manager. 
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commands r e c e iv e d such that the syst e m applies m e thods r e sponsive to the commands for an 
appropriate application including on e of the active applications . 



20. (Currently Amended) The system as recited in claim 19 5 wherein the control 
component selects a method associated with an active user application, appropriate application 
further includes on e of an inactive application, an application with a graphical component and 
an application with other than a graphical component. 

21. (Currently Amended) The system as recited in claim 19, wherein the multi-modal 
history of events maintains meta information of input events including speech and non-speech 
input events and output events generated by the multi-modal system commands ar e input to th e 
dialog manager by one of a t e l e phone, a computer, and a p e rsonal digital assistant . 

22. (Currently Amended) The system as recited in claim 19, wherein the dialog 
manager determines a current context of the input speech event by traversing linked events in 
the multi-modal history of events wh e rein th e multi modal history includ e s a linked list of all 
e vents to associate a giv e n command to th e appropriat e application . 

23. (Currently Amended) The system as recited in claim J_9 33, wherein events in the 
multi-modal history of events are further linked by time, transaction and class wher e in th e 
ev e nts in the multi modal history includ e at l e ast on e of events linked by tim e , by typ e , by 
transaction, by class and by dialog focus . 

24. (Currently Amended) The system as recited in claim 19, wherein the control 
component references all active the user applications to determine the at least one method 
which is appropriate based on the current context of an input speech command th e commands . 

25. (Currently Amended) The system as recited in claim 19, wherein an input speech 
event th e command is presented to the dialog manager in a formal language such that a plurality 
of human utterances represent an action to be taken. 
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